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FOREWORD 


Effective reporting to Parliament supports the government’s ongoing objectives of transparency 
and accountability. A continued effort to improve the information contained in government 
reports ensures that parliamentarians have the information they need to determine whether the 
government is managing for results. 


The government’s new Expenditure Management System has increased the demand for 
performance information to better support the government’s decision-making process and the 
three phases of the management cycle—planning, implementation and monitoring, and reporting. 
Better performance information is also key to the Government of Canada’s ongoing commitment 
to produce departmental planning and performance reports of the highest quality. 


This is the second edition of the Treasury Board of Canada Secretariat’s Performance Reporting: 
Good Practices Handbook. Departments and agencies can make use of this practical resource as 
they produce their departmental performance reports (DPR). Its aim is to demonstrate how and 
why the application of the Government of Canada reporting principles leads to quality reporting. 
The handbook presents a wide array of good practices on how to apply reporting principles, such 
as associating performance with plans or linking resources to results. 


The 2008 edition of the handbook includes examples of good practices drawn from the 2006-07 
DPRs, each presented with a description of how it exemplifies key aspects of the Government of 
Canada reporting principles. It also includes a high-level analysis of the most recent results of the 
Management Accountability Framework process and an elaboration on selected good practices to 
provide a more detailed illustration of their application in performance reporting. 


Alister Smith 


Mh benithr 


Assistant Secretary 
Expenditure Management Sector 
Treasury Board of Canada Secretariat 
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About this Handbook 


As part of the government’s efforts to improve reporting to Parliament, the Performance 
Reporting: Good Practices Handbook has been developed to help public service employees who 
prepare their organization’s departmental performance report (DPR). This handbook does not 
replace the Guide to the Preparation of Part III of the Estimates. Instead, it is intended to be a 
practical resource to be used in conjunction with the guidelines. 


The handbook focusses on illustrating what it means to apply the Government of Canada 
reporting principles to DPRs. It identifies good examples and practices in public reporting to 
demonstrate how quality reporting can be achieved. The aim is to support departments and 
agencies in preparing public reports that are reliable, credible, balanced, concise, clear, and of 
the highest quality for parliamentarians and Canadians. While the focus of the handbook is on 
DPRs, the content does touch on reports on plans and priorities (RPP) and may be of use in their 
preparation. 


Section I presents the context in which reporting takes place and the role it plays within the 
business of the government. Connections are made between various reports and to key policies. 


Section II outlines the Government of Canada reporting principles, reviewing their development 
and relationship with the standards prepared by other organizations. Section IT is subdivided into 
four sections, one for each principle: 


1. Focus on the benefits for Canadians, explain the critical aspects of planning and 
performance, and set them in context 


2. Present concise, credible, reliable, and balanced information 


Associate performance with plans, priorities, and expected results, explain changes, and 
apply lessons learned 


4. Link resources to results 


A brief discussion of what each principle means for the production of performance reports is 
then followed by examples of good practices drawn from the 2006-07 RPPs and DPRs.' 


1. Note that the images used to illustrate the examples of good practices are taken directly from RPPs and DPRs. 
The clarity of images may not be optimal. Please consult the original versions (hard copy or electronic) of these 


reports to see the clearest presentation. Links are provided in this document. 
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Note that not all reports are assessed each year, and the examples were selected from 56 of the 
90 reports tabled. 


The appendix to the handbook contains a list of additional resources, a glossary of key terms, and 
a list of contacts. 


New this year 
The 2008 version of the Performance Reporting: Good Practices Handbook includes several 
new elements: 


> Connections boxes that demonstrate linkages to criteria under other principles; 

> More detailed illustration of the application of certain selected criteria in performance 
reporting; 

>» Material on establishing clear performance expectations in the RPP; 


> A focus on concise reporting with the addition of a criterion for the use of links to further 
information; and 


> Incorporation of analysis of Management Accountability Framework (MAF) results. 
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Section I: Context 


The duty to report on plans and performance to Parliament is not a recent development. 

A longstanding requirement within Canada’s parliamentary tradition, the accountability concern 
of the House of Commons regarding the use of financial resources traces its roots back several 
centuries in Great Britain. In the Canadian context, the Constitution Act, 1867 established the 
relationship between the Crown and Parliament, using the British (Westminster) system as its 
foundational model. 


The present context is different, however. The current environment in which parliamentarians 
and public service employees work is characterized by declining trust in public institutions, an 
accelerating revolution in communication technologies, and increasingly complex and 
interrelated public policy issues. Moreover, the government is expected to function at ever- 
increasing speed and the demand for better and timelier information is on the rise. It is in this 
context that government priorities include a focus on modernizing its accountability and 
expenditure management regimes. In particular, the federal government has called for a redesign 
of the federal Expenditure Management System. 


Budget 2006 set out three main principles: 


| The Expenditure Management 


> Government programs should focus on results and | System is the framework for the 
value-for-money; || development and implementation of 


| the government's spending plans and 
||| priorities within the limits established 
|| by the budget. It supports all 

|| government spending decisions. 


> These programs must be consistent with federal 
responsibilities; and 


> Programs that no longer serve the purpose for 
which they were created should be eliminated. 


Budget 2007 elaborated on key elements of the new system, including the introduction of 
strategic reviews, a process that will, over a four-year cycle, determine whether programs are 
achieving their intended results, are efficiently managed, and are aligned with the Government’s 
priorities. 


Budget 2008 confirmed the Government’s commitment to responsible spending, which includes 
the commitment that new spending proposals will be supported by better information, and 
performance will be benchmarked against best practices. In addition, the results of the first round 
of strategic reviews were presented in Budget 2008 as part of the new approach to managing 
existing spending. Savings from these reviews will be reallocated to higher priorities. 
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Implementing the redesign of the Expenditure Management System will require that quality 
performance information be produced for the purposes of internal management as well as for 


parliamentary reporting. 


Effective public reporting is important 


Effective public reporting means that the public is provided with timely, accurate, clear, 
objective, and relevant information about the plans and performance for government policies, 
programs, services, and initiatives. This information is necessary for Canadians—individually or 
through representative groups or members of Parliament—to participate actively and 
meaningfully in the democratic process. Without clearly communicated plans, priorities, and 
expected results, coupled with the reporting of results against those plans and performance 
expectations, the ability of parliamentarians to hold the government to account is impeded. 
Without effective public reporting, accountability and transparency in government are 
diminished and trust in public institutions suffers. 


Parliamentary reporting cycle 


Each year as part of the parliamentary reporting cycle, the president of the Treasury Board tables 
in Parliament several reports, including the following: 


1. the Main Estimates; 

the Supplementary Estimates; 
reports on plans and priorities; 
departmental performance reports; 


Canada’s Performance; and 


DS me a 


the Public Accounts of Canada. 


A review of the role and importance of departmental reporting for accountability and better 
management is therefore germane. 


By law, all government spending must be authorized by Parliament. There are two broad ways 
the government obtains such authorization. 


First is statutory approval. In this case, specific legislation establishes ongoing spending 
authority for certain government programs. Transfer payments, such as Employment Insurance 
or the Canada Health Transfer and the Canada Social Transfer, are examples of statutory 
spending. Typically, statutory programs account for about 65 to 70 per cent of total planned 
spending. 
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Second is annual approval. Here, authority for spending must be obtained each year through 
Parliament’s approval of appropriation bills. Ongoing departmental operations fall in this 
category of authorization. 


In support of supply bills tabled to seek annual authorization from Parliament for spending, the 
government produces the Estimates—detailed documentation that outlines expenditure plans and 
identifies spending authorities (votes) and the amounts to be included in the appropriation acts 
(once passed)—organized by ministry and vote and, within each department, by program 
activity. Details of statutory spending are included for information only. 


The Estimates consist of three parts. Part I, the Government Expense Plan, provides an overview 
of federal spending and summarizes the relationship between the budget and Part II, the Main 
Estimates. Part II directly supports an appropriation act. The thick, factual blue book of Part I 
and II contains summary analysis and context to explain to readers why departments are seeking 
these funds. The reports on plans and priorities (RPP), which are produced by departments and 
tabled in Parliament by the president of the Treasury Board on their behalf, provide a greater 
level of analysis and detail of the results to be achieved with available resources. RPPs and 
departmental performance reports (DPR) together form Part II of the Estimates. RPPs and DPRs 
will be discussed in more detail below. 


By standing order of the House of Commons, the Main Estimates are required to be tabled on or 
before March | of each year—one month in advance of the fiscal year they concern. 


Appropriation bills are tabled in Parliament and seek authority for the individual appropriations 
(or votes) for each department. Authority from Parliament for the total appropriations of a fiscal 
year is sought in two portions. The first, known as interim supply, is sought and granted in late 
March and typically covers the first three months of the new fiscal year. The second, known as 
full supply, is typically sought and granted in June to cover the remainder of the fiscal year. This 
approach is intended to provide parliamentary standing committees with time to scrutinize 
planned spending in the Estimates before the introduction of appropriation legislation in 
Parliament. 


Supplementary Estimates are used to seek parliamentary authority for new spending plans 
outlined in the budget but not previously included in the Main Estimates and for in-year 
spending decisions that occur outside of the budget. 


Canada’s Performance is an annual report tabled by the president of the Treasury Board. It tracks 
the federal government’s contribution to Canada’s performance as a nation in four key spending 
areas: economic affairs, social affairs, international affairs, and government affairs. The report 
provides a whole-of-government perspective from which to view the results and resources of 


a 
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individual federal departments and agencies as presented in their DPRs. Along the same lines, 
the online RPP Overview for Parliamentarians was developed in 2007 to present a whole-of- 
government view of the plans of departments. In 2008, the Government of Canada Planning and 
Performance Gateway was launched, a site that includes links to RPPs and DPRs and allows 
users to navigate through the Government’s planned spending and expected results in the four 


outcome areas. 


The Public Accounts of Canada provide the audited summary financial statements of the 
government along with additional details on departmental financial activity. The Public Accounts 
of Canada also include a comparison to the budget and a new section with financial analysis, 
trends, and graphics. These are tabled in the fall. 


Figure 1: The Parliamentary Reporting Cycle 
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About RPPs and DPRs 


The RPP is an individual departmental planning document that covers a three-year period. 


Government of Canada 


It explains to parliamentarians a department’s detailed spending plans, priorities, and expected 
results. Parliamentarians use this information in support of their scrutiny of the Estimates before 
voting supply. Departments describe the context and environment in which they operate, 
showing how their work (plans and priorities) connects to broader government-wide priorities, 
such as those articulated in the budget or the Speech from the Throne. Discussion of how 
challenges, risks, and past lessons learned have informed current plans lends balance and 
credibility to the reports and their presentation of departmental plans and performance 
expectations. Most importantly, the RPP focusses on discussing plans and expected results and, 
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in turn, connecting these to the resources (financial and human) that will be used to achieve 
them. 


After the end of each fiscal year, departments report back to Parliament through their DPRs, 
which provide information on their performance in delivering on plans, addressing priorities, and 
achieving the expected results outlined in their RPPs for that fiscal year. DPRs provide 
parliamentarians with an account of departmental accomplishments and shortcomings for the 
reporting period and of how public resources were used to achieve value-for-money. Similar to 
the RPPs, in order to set performance in context, the DPRs discuss the context, risks and 
challenges, and operating environment in which departments achieved results. 


The basis of reporting is the Management, Resources, and Results 
Structure 


The basis of reporting in the RPP and the DPR is the Management, Resources, and Results 
Structure (MRRS).* The MRRS Policy was approved by the Treasury Board in 2005 and is 
currently undergoing a government-wide and systematic implementation. It is recognized that, 
as the Policy becomes embedded in how departments operate and are managed, gradual 
improvements will be seen in performance reporting, as seen in the development of performance 
measurement capacity for example. 


The MRRS provides an enduring framework for reporting progress toward strategic outcomes. 
A stable reporting basis allows for consistent comparisons of performance over time. 


2. For more information on the MRRS, visit http://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=12412 
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Figure 2: Management, Resources, and Results Structure 
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Pee Indicates the required level of reporting in RPPs and DPRs. 


In the RPP, performance indicators at the strategic outcome level tell readers what progress the 
department intends to achieve toward long-term, enduring benefits for Canadians. At the 
program activity level, plans and expected results, along with their MRRS-based performance 
indicators, are reported in the RPP. With this approach, readers can understand what will be 
achieved at the program activity level and at what cost and can trace the program activity 
contribution toward achieving the strategic outcome. 


The expected results and performance indicators from the department’s performance 
measurement framework, which are based on the MRRS, provide the foundation for judging 
performance in the corresponding DPR. DPRs provide a comprehensive yet succinct picture of 
departmental performance against the expected results presented in the RPP for the program 
activities and strategic outcomes. 


Parliamentarians are the primary target audience for RPPs and 
DPRs 


The target audience for planning and performance reports is parliamentarians. They rely on these 
reports to perform their role of holding the government accountable for the public funds 
entrusted to it and as a means for sharing with their constituents the results of government 
programs and initiatives. 
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Information in the RPP and DPR should therefore be relevant and useful to members of 
Parliament and to the Canadians they represent. The reports should provide enough information 
to demonstrate how resources and program activities, including key programs and services, 
logically support the achievement of strategic outcomes. 


Parliamentarians need reports that respond directly to their key questions, provide high-quality 
information, and are clear and concise. Both reports must logically demonstrate to 
parliamentarians and Canadians how departmental achievements will make a difference in their 
lives. 


What’s been said, what we’ve heard 


Various stakeholders have identified issues with departmental reporting and, in particular, with 
the RPPs and DPRs. Parliamentary committees, the Office of the Auditor General of Canada, the 
Canadian Institute of Chartered Accountants (CICA), and the Treasury Board of Canada 
Secretariat have all reviewed the quality of departmental reports. 


A number of issues have been consistently identified by these stakeholders: 


1. Lack of balanced reporting—The reports generally focus only on good news and neglect 
the discussion of expected results not achieved and of lessons learned. 


2. Credibility of performance information—Key findings from internal and external audits 
and evaluations are seldom used to substantiate performance; there is a lack of 
information on the reliability and credibility of the data presented in the reports; and there 
is limited discussion of risks and challenges faced by the organizations. 


3. Inconsistency between years and between departments—Baseline data are rarely included 
to allow for comparisons. 


4. Lengthy reports that lack high-level analysis—Focus is needed on the key facts. 


Too much jargon and complex language—Reports should use plain language, keeping in 
mind diverse audiences. 


Stakeholders have also noted that there are gaps in the performance story (e.g. divergence 
between planned and actual performance) and these gaps are rarely directly addressed. The 
reports have also been described as focussing too heavily on activities and outputs, rather than on 
outcomes. Very few reports tell a complete and coherent performance story where readers can 
determine what the department had planned to achieve overall, what it did achieve overall, and 
what it is doing to improve performance in those areas where performance did not meet 
expectations. 
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Management Accountability Framework 


Performance reporting based on the Government of Canada reporting principles is in line with 
the Management Accountability Framework’s (MAF) work on public sector management and 
accountability. MAF is a vision for good management, establishing a framework for 
management accountability; an analytical tool to identify strengths and weaknesses; and a 
process of assessment and engagement to develop action plans for improvement and report on 


the state of management. 


RPPs and DPRs have been assessed as part of the MAF process since its third round, with the 
assessments of Round 4 and Round 5 having the same methodological basis. That is, a similar set 
of criteria based on the Government of Canada reporting principles was used each year to 
evaluate the quality of reporting to Parliament. This consistency allows year-over-year 
comparisons to identify areas of improvement as well as areas of continued concern.° 


Overall, the quality of reporting to Parliament is improving. As compared to Round 4, the 
number of “Acceptable” ratings has increased. The average MAF rating, however, remains at 
“Opportunity for Improvement.” No reports were assessed as “Attention Required” or “Strong.” 


3. All MAF criteria are reflected in the good practices in this handbook; however, not all good practices are assessed 
through the MAF process. 
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The chart below lists the assessment criteria for which departmental performance was 


strongest and weakest. 


Strengths 


e The reports present strategic context and 


operating environment, including challenges, 


risks, Opportunities and capacities. 


e Informative financial tables are included and 
explained with text (where necessary). 


e Performance expectations in the RPP are 
clear. 


e The DPR effectively uses comparisons and 
links to further information. 


e The Program Activity Architecture (PAA) is 
presented clearly in the reports (crosswalks 
included where necessary). 


Weaknesses 


The DPR links performance to plans: 
performance is reported against plans in the 
RPP. Discussion of any changes in plans and 
how they affected performance is included in 
the DPR. 


The DPR provides factual, independently 
verifiable evidence-based performance 
information; information on the source, validity 
and credibility of data used and relevant 


findings from audit and evaluation are included. 


Linkages between resources and results. 


The DPR is balanced; positive and negative 
aspects of performance are reported. 


PAA Basis: reports performance by Program 
Activity (PA) and links PA performance to 
strategic outcome (SO). 


Continued improvement in the application of the Government of Canada reporting principles will 
help to address the issues identified by report users as well as by the MAF assessments. This will 
be the focus of the remainder of the handbook. 
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Section Il: Principles for Effective Reporting to Parliament 


Principles for effective reporting to Parliament serve as a conceptual foundation for the 
preparation of Part III of the Estimates and provide a number of benefits. First, they help those 
doing the reporting to “make good judgments and give [. . . ] confidence that their judgments 
will be fairly received.”* Second, principles support the users of performance reports because 
they provide “grounds for confidence that the judgments exercised in reporting are fair, neither 
arbitrary nor self-serving.”* Third, with continuous improvement in performance reporting as a 
long-standing goal, principles “point the way to what reporting could and should be’°—that is, 
they offer a vision or an ideal to work toward. 


Recognizing these benefits, the Treasury Board of Canada Secretariat has developed a set of 
principles over the last several years for the federal reporting context. These principles evolved 
in consultation with parliamentarians, the Office of the Auditor General of Canada, and the 
CCAF. Furthermore, these reporting principles now apply to RPPs and DPRs. 


The following Government of Canada reporting principles support and guide the preparation of 
RPPs and DPRs. Taken together, these principles show the link between plans, performance, and 
achievements and they demonstrate departmental commitments to managing for results. 


Government of Canada Reporting Principles 


> Principle 1: Focus on the benefits for Canadians, explain the critical aspects of planning 
and performance, and set them in context 


>» Principle 2: Present concise, credible, reliable, and balanced information 


> Principle 3: Associate performance with plans, priorities, and expected results, explain 
changes, and apply lessons learned 


> Principle 4: Link resources to results 


In September 2006, the Public Sector Accounting Board (PSAB) of the Canadian Institute of 
Chartered Accountants (CICA) issued a Statement of Recommended Practice (SORP-2) to guide 
public performance reporting for governments or governmental organizations. Consistency 
between the Government of Canada reporting principles and the SORP-2 is demonstrated in the 
crosswalk provided at the link below, which aligns key statements found in the SORP-2 with the 
corresponding Government of Canada principle. It should be noted that, while these principles 


4. CCAF, Reporting Principles: Taking Public Performance Reporting to a New Level (2002), p. 3. 
5. Ibid. 
6. Ibid. 
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guide reporting on plans, priorities, and performance for both the RPP and DPR, the SORP-2 
deals specifically with performance reporting. 


For a crosswalk of the federal reporting principles and the CICA-PSAB SORP-2, visit 
http://www.tbs-sct.gc.ca/rma/dpr3/06-07/principles-principes/princip_e.asp. 


The examples discussed in this handbook complement good practices identified by the CCAF in 
its 2007 publication, What can we learn from effective public performance reporting? Good 
practices for Central Agencies, Legislators, Auditors, and Report Producers. 


Practical application of principles 


The following pages contain explanations and illustrations of how to apply the Government of 
Canada reporting principles when preparing performance reports. While these practices are 
presented individually, in actuality they are not discrete or isolated. This means that carrying out 
reporting practices in an integrated and connected way is important. 


Before looking at each principle individually, some general comments on the application of the 
reporting principles can be made: 


> The information reported should be straightforward. It should flow logically across key 
reporting elements (i.e. strategic outcomes, program activities, and their expected and actual 
results) and across reports (i.e. from the RPP to the corresponding DPR). 


> The reports should focus on outcomes, i.e. expected and actual results at the program activity 
level and progress made toward the strategic outcome(s). 


— RPPs should clearly communicate the strategic outcome(s) and the program activities and 
their expected results, discussing how the department plans to make progress toward the 
strategic outcome(s) through its program activities. 


— DPRs should report back against those plans and expected results. Performance at the 
program activity level and the contribution of program activities to the strategic 
outcome(s) should be clearly described and well substantiated with credible and reliable 
evidence. 


> The reports should present information concisely and with limited use of jargon 
so that they are clear and easy to understand for parliamentarians and Canadians. 


> DPRs should tell a balanced performance story, addressing both the positive and the negative. 
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It should be noted that each of the examples discussed in this handbook presents one way of 
applying the Government of Canada reporting principles. Each example should not be 
considered in isolation; it is not the only way. Innovation is encouraged. Moreover, there is no 


one perfect report. 
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Principle 1: Focus on the benefits for Canadians, explain the 
critical aspects of planning and performance, and set them in 
context 


Why should public performance reports focus on the benefits for Canadians? Recall why RPPs 
and DPRs are prepared, how they are used, and by whom. These reports are key accountability 
documents that present the government’s financial and non-financial plans and performance and 
provide the basis for scrutiny by parliamentarians. The government is spending taxpayers’ 
money, and parliamentarians represent Canadians. Departmental reports should therefore 
demonstrate how the lives of Canadians will be and are improved by departments’ plans and 
results. 


Focussing on the few critical aspects of planning and performance enhances the usefulness of 
public reports by providing a concise picture of the information parliamentarians need to know. 
Parliamentarians do not have unlimited time to read through RPPs and DPRs and need to be able 
to get clear messages about departmental planning and performance quickly. Too much 
information impedes the ability of parliamentarians to hold the government to account. 


Identifying critical aspects of planning and performance involves assessing what is relevant and 
significant for each strategic outcome and program activity. Information in an RPP and DPR 
should be relevant to members of Parliament and to Canadians and should explain the benefits 
for Canadians that the department aims to achieve through its strategic outcomes and program 
activities. Reporting on other critical items that have an impact on plans or performance could 
include a description and a discussion of how they are expected to, or did, affect departmental 
plans and performance. 


Establishing the context of plans and performance is important because it helps readers 
understand the range of considerations that must be taken into account when planning and that 
affect performance. It helps to establish reasonable parameters for assessing plans and 
performance. 


15 


>> 


16 


Performance Reporting : Good Practices Handbook 2008 


To apply this principle: 


> 
> 
> 
> 
> 


Clearly present the PAA 

Discuss priorities within the context of the MRRS 

Link to Canada’s Performance 

Demonstrate links to broader government priorities 

Discuss challenges, risks, opportunities, and their impacts on plans and performance 
Discuss horizontal links 

Describe delivery mechanisms 


Include responses to parliamentary committees and findings of the Auditor General of 
Canada 


\ Clearly present the PAA 


Explaining the critical aspects of planning and performance begins 


with identifying what these aspects are. In large part, articulating Connections 
the core objectives of your department and the key results to > Use the MRRS as the 
which it is committed will achieve this first step. With the MRRS || basis of reporting 


as the basis of managing and decision making for results, it is your 
strategic outcome(s) and your PAA that will serve as the 
framework through which to explain your department’s critical 
aspects of planning and performance. 


> Link performance with 


plans 


Consequently, presenting a clear PAA is key to putting this principle into practice. It should be 


clear in the report what the strategic outcomes and program activities are and how they are 


connected. Presenting your PAA visually and through discussion is an effective way of 


communicating this information to readers. In the RPP, it is important to demonstrate changes 


to the PAA since the last reporting cycle through a crosswalk and to discuss the effect on plans. 


The DPR should use the same PAA as the one used in the RPP. In exceptional circumstances, a 


later PAA may be used. Should this occur, it is important to provide a crosswalk and discuss the 
effect on performance. 


Good practice: Clearly present the PAA 


Correctional Service Canada 
DPR 2006-07, p. 10 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/pen/pen00-eng.asp 


Strategic Outcome 


Program 
Activities 


Care and Custody 
Administering a sentence through 
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PROGRAM ACTIVITY ARCHITECTURE (PAA) 


Rehabilitation and Case Management 
Assisting in the safe rehabilitation 
and reintegration of offenders 


Offenders are safely and effectively accommodated and reintegrated into Canadian communities 


CORCAN 
Assisting in the safe 
rehabilitation and 


reintegration of offenders into 


communities 


reasonable, safe, humane custody 


into Commum tes 


} 


Accommodation 
Services 


Institutional 
Services 


Program 
Sub-activities 


Inmate Pay 


Provision of 

work opportunities 
and employability 
skills to 

Offenders 


Limited financial 
resources are 
provided to 
offenders in 
accordance with 
their correctional 
plans to address their 
needs and save 

for their release 


Access to programs 
designed to address 
offenders’ 
ilentified needs 
and to contribute to 
successful 
reintegration into 
the community 


Offenders receive 
essential health 
care in 
accordance 

with 
professionally 
accepted 
standards 


The safety, security 
and rights of staff, 
offenders and the 
public are 
safeguarded 


Offenders 
sentences are 
managed based 
on informed 
decisions, taking 
into consideration 
interventions, 
risk management 
and public safety 


Accommodation of 
offenders is safe, 
secure and humane 


Institutional 
services 
contribute to 
the safe, secure 
aod humane 
management of 
offenders 


Key Results 


ane | \ 

Offenders are 
provided with 
nutritious, 
balanced meals, 
clean working 
aod living 
environments, 
with necessary 
supplies and 
clothing aod with 
com munis options to purchase 
standards personal items 


bo) Le LS 


Offenders are 
provided with 
approved 
remuneration 
in accordance 
to the level of 
participation 
in their 
correctional 
plan 


Offenders are 
provided with 
suitable 
accommodation 
and living 
conditions 


Work opportunities, 
employability skills 
and training are 
provided in 
institutions and 
offenders are 
supported in finding 
employment when 
released to the 
community 


Correctional 
programs are 
delivered in 
response (0 
offenders’ 
identified 
needs 


Offenders are 
medically 
assessed® and 
essential 
physical aod 
mental health 
needs are 
addressed in 
accordance with 
professional and 


Security needs, 
within 
correctional 
facilities, are 
identified and 
addressed, within 
a human rights 
context 


Throughout their 
sentence, 
offenders are 
assessed, 

assisted and 
provided with 
mecessary 
interventions 


Key Outputs 


Num ber! %oage of 
offenders enrolled in 
employment (raining: 
member! age of 
certificates earned; 
number age of 
offenders receiving 
services in the 
community; number 
and “age of offenders 
finding employment 
iw the community 


Number “oage 
of offenders 
remunerated 
in accordance 
with their 
participation in 
their 
correctional 
plans 


Accomumoda tions 
meet all legal 
and policy 


requirements 
| Ses 


Clean working 
aod living 
environments 
as per 
recognized 
standards, provision of 
nutritious, balanced meals 

as per Canada Food Guide and 
with respect to religions and 
medical needs of offenders, 
provision of clothing aad 
purchase of personal items ns 
per policy 


Number/rate of 
security incidents 
by type 


Medical intake 
assessments* 
completed and 
services provider 
according to 
professional 
standards 


Number age 
of offenders 
completing 
programs in 
institutions 
and the 
community 


‘Timely case 
preparation: 
number of 
offenders 
successfully 
Feintegrated into 
the community; 
number of 
revocations with 
offence and completion 
of successful transfers 


Key 
Performance 
Indicators 


* Assessments are done by a health 
professional, not necessarily a medical 
doctor 


Note: An amended PAA was approved by Treasury Board in June 2007 and will be implemented in CSC's 2008-09 RPP. 


Why is this a good practice? 


Both the RPP and the DPR present a clear illustration of the PAA, which includes the SO, 
PAs, and sub-activities. 
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\ Discuss priorities within the context of the MRRS 
Certain items may be identified as taking precedence over others 
in order for progress to be made toward the strategic outcome(s); Connections 
these may change from year to year or within a single reporting 
cycle. Any priorities identified in the RPP and DPR should be 
discussed within the context of the MRRS, and the linkages 
between priorities and program activities should be clearly Link resources to 
demonstrated. Specifically, how the priorities are expected to results 

contribute to the strategic outcome(s) should be discussed so that 
readers understand their relative importance. 


Use the MRRS as the 


basis of reporting 


Good practice: Discuss priorities within the context of the MRRS 


National Defence 
DPR 2006-07, p. 23 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/dnd/dnd00-eng.asp 
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Program Activities 


Corporate Priorities 2006-2007 Generate and | Conduct Contribute to Type of 
Sustain Operations Canada and Priority 
Integrated - the 
Forces International 
Community 


Protect Canadians through the Conduct of Operations 


Conduct operations at home and abroad; and a O 


Enhance operational partnerships with other x O 
government departments, key security agencies ~ 
and allies. 


a 
Transform and Modernize the CF 


Adopt a fully integrated and unified approach 
aligning force structure to ensure operational 
effectiveness. Key initiatives include the 
development of Canada COM, six Area Joint 
Task Forces, CEFCOM, CANSOFCOM, | oO oO N 
CANOSCOM, MILPERSCOM, a Strategic Joint 
Staff, a Rapid Reaction Force, Mission Specific 
Task Forces and a managed readiness 

system to enhance its ability to generate and 
deploy integrated forces; and 


Adopt an integrated and strategically driven force 
development framework and process, including 
expanding the Regular and Reserve forces, | N 
ensuring they are well trained and well equipped, 
and developing a diverse and highly motivated 
Defence Team. 


Foster Management Excellence in the Defence Institution 


Enhance strategic investment planning and 


accelerate the activities of procurement reform; sad N 
and 
Ensure successful implementation of modern 

p Ê Oo N 


comptrollership initiatives and the Public Service 
Modernization Act. 


Contribute to the International Community in Accordance with Canadian Interests and Values 


Expand strategic partnerships with key security 


departments and other government departments 7 O 
and agencies; and 

Continue to strengthen defence and security 

arrangements with the United States to enhance oO r O 


domestic and continental security, and with 
Canada’s allies to enhance international security. 


Legend: 
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Why is this a good practice? 


The linkages between priorities and program activities are clear. Detail is provided on the 
type of priority (new versus ongoing) and whether each priority is of primary or secondary 
concern. 


\ Link to Canada’s Performance 

Government of Canada outcome areas, as represented in the whole-of-government framework 
used in Canada’s Performance, are the long-term and enduring benefits to Canadians that more 
than one federal department or agency is working to achieve. Aligning your department’s 
strategic outcomes and program activities with the Government of Canada outcome areas offers 
a high-level overview of how the performance of individual departments and agencies 
contributes to broader, government-wide outcomes in the following spending areas: economic 
affairs, social affairs, international affairs, and government affairs (federal organizations that 
support all departments and agencies). 


This alignment can effectively be done with a visual representation along with a short 
explanation or discussion of the departmental contribution. 


Good Practice: Link to Canada’s Performance 


Western Economic Diversification Canada 
DPR 2006-07, p. 15 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/wco/wco00-eng.asp 
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Alignment With Whole of Government Framework 


WD’s Strategic Outcomes and Program Activities are aligned with the Whole of Government 
Framework, as follows: 


# : : Government of ; j : RE 
Spending Areas Canada Outcone WD Strategic WD Program 


Areas Outcomes Activities 


Innovation 
1. An innovative and 
knowledge-based economy 
Entrepreneurship & 
Innovation 
2. Strong Economic Business Development & 
Growth : Entrepreneurship 


3. Income security and ë ; 

employment for Canadians Community Economic 
Planning, Development, 
& Adjustment 

4. A fair and secure Community Economic 


marketplace Development 


Infrastructure 


5. A clean and healthy 
environment 


: : Coordination & 
International Collaboration 
_ Affairs 


Policy, Advocacy, & Advocacy 
| Coordination 


Research & Analysis 


Why is this a good practice? 


The program activities and strategic outcomes are clearly identified and their alignment to 
the whole-of-government framework is evident. 


It is equally important to discuss and explain the alignment of your department’s program 
activities and strategic outcomes with the Government of Canada outcome areas. For a good 
example of this practice, see the Social Sciences and Humanities Research Council of Canada 
DPR (pp. 15-16) at http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/ssh/ssh00-eng.asp. 
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V Demonstrate links to broader government priorities 

In addition to the whole-of-government framework, another context in which to situate 
departmental outcomes is current government policy. The broader priorities and plans of the 
government are established at the beginning of a session of Parliament with the Speech from the 
Throne and annually with the federal budget. While Government of Canada outcome areas are 
meant to endure beyond the mandate of a particular government, the Speech from the Throne and 
the budget provide a picture specific to the current government. 


There should therefore be an indication of how your department’s outcomes relate or contribute 
to the government’s broader priorities as established in the Speech from the Throne or the 
budget. Other government-wide initiatives could also be referenced and discussed in terms of 
their effect on the plans and performance of your department. 


It is recognized that the Speech from the Throne and the budget are overarching documents and 
it may be difficult for some departments and agencies (particularly smaller ones) to see their 
mandates and work in these documents. 


Good practice: Demonstrate links to broader government priorities 


Canadian International Development Agency 
DPR 2006-07, p. 9 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/ida/ida00-eng.asp 
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There is a high level of interest in Canada to improve aid effectiveness actions. 
In Budget 2007, the Government reiterated the need to improve the effectiveness of Canadian 
aid and ensure accountability for results by presenting a three-point program aimed at: 


e Strengthening focus: Canada will focus traditional bilateral aid in fewer countries and will 
aim to be among the largest five donors in core countries of interest; 


e Improving efficiency: Canada will establish a benchmark for reducing administrative costs 
and will put more staff in the field; and, 


e Increasing accountability: Canada will examine options to ensure the independent 
evaluation of our aid program and will report more frequently to Canadians. 


This program reinforced commitments made by the Government in 2006, in both the Speech 
from the Throne and the Budget: to ensure greater accountability in the distribution and results 
of Canada's international assistance. It is within this context that CIDA developed its aid 
effectiveness agenda’ which includes: 1) a strategic focus of our programming where it can 
have the greatest impact, 2) strengthened program delivery, 3) effective use of the Agency's 
resources, and 4) a clear accountability for results. 


Why is this a good practice? 


The Speech from the Throne and the budget are cited and discussed extensively 
throughout the DPR. In this example links are made between specific commitments made 
by the Government and the development of the Canadian International Development 
Agency's aid effectiveness agenda. 
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\ Discuss challenges, risks, opportunities, and their impacts on plans and performance 


Description and analysis of the operating environment and the 


strategic context for the reporting period provide a frame of reference Connections 
for readers to understand and assess the plans and results of the > Use comparisons 
department. and trends 


> Include links to 


Internal and external challenges, risks, and opportunities (including 


management and human resources capacity considerations) should be further information 


identified at the departmental level. Explanations of how these will 
affect your plans and performance and be addressed in the delivery of 
program activities or key programs and services are also essential. 


Good practice: Discuss challenges, risks, opportunities, and their impacts on 
plans and performance 


Public Health Agency of Canada 
DPR 2006-07, p. 16 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/ahs/ahs00-eng.asp 
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Strategic Context/Operating 
Environment 


The expanding global economy, the 
convergence of people in large urban areas 
and the ease with which people and goods 
travel around the world are but some of the 
factors challenging Canada’s public health 
system. 


External factors which influenced the 
Agency’s activities during 2006-07 included 


the emergence of infectious diseases, such as 
avian influenza and other potential 
pandemics, both nationally and 
internationally; natural disasters; Canada’s 
gradually aging population; social trends 
affecting the risk of chronic diseases; the 
changing nature of our environment; and the 
continued rapid evolution of science and 
technology. 


Infectious Disease Levels and 
Trends 


The number of Canadians dying from or 
living with infectious diseases has been 


climbing since the 1980s. 


ace 


Risks of Avian and Pandemic 
Influenza 


There were two major infectious disease threats 
that Canada faced in 2006-07. Each could have 
had a significant impact on Canada’s economic 
and social stability as well as on collective and 
individual health and safety. The first was the 
potential for the highly contagious and deadly 
H5N1 (Asian) sub-type of avian influenza to 
spread to domestic birds in Canada. The second 
was the growing potential for the appearance of 
a new strain of this (or another) virus that has 
adapted to humans, resulting in human-to- 
human transmission and the possible setting off 
of a human influenza pandemic. According to 
WHO, the occurrence of the next pandemic 
influenza is “a question of when, not if.” 


The HSNI (Asian) avian influenza virus has 
demonstrated the ability to infect and cause 
fatal illness in humans. During the period from 
December 2003 to April 2007, 291 human 
cases, resulting in 172 deaths, were laboratory- 
confirmed in 12 countries. 


Why is this a good practice? 


agency's work. 


The Public Health Agency of Canada’s DPR includes a comprehensive discussion of the 
strategic context and operating environment that addresses a number of key issues that 
influence its planning and performance, including a discussion of infectious disease levels 
and trends, risks of avian flu and pandemic influenza, natural disasters, demographics, and 
risk factors for chronic disease. Elsewhere in the report, efforts to establish an internal risk 
assessment and profile are described, as are several external risk factors that affect the 
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Including a discussion of risk mitigation is an important component of this good practice. See the 
2006-07 DPR of the Canadian Institutes of Health Research (pp. 13-16) for an example: 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/cri/cri00-eng.asp 


\ Discuss horizontal links 

Increasingly, the work of departments and agencies is done through horizontal partnerships and 
initiatives. Indicating your department’s involvement in horizontal partnerships and initiatives 
contributes to an understanding of your operating environment and points to other sources of 
information on topics and issues of interest. 


Important horizontal linkages and involvement in government-wide initiatives should therefore 
be identified and their implications surrounding planning and performance should be explained. 


rs 
Good practice: Discuss horizontal links 


Citizenship and Immigration Canada 
DPR 2006-07, pp. 16-17 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/imc/imc00-eng.asp 


Critical Partnerships 


The successful management of Canada’s immigration program depends on ongoing cooperation 
with a wide range of partners. CIC works with many partners on both international and 
domestic immigration issues, but stronger relationships with an even broader variety of partners 


are needed to build Canada’s future. 


CIC and the CBSA share responsibility for administering IRPA and support each other in 
carrying out their respective functions. With support from the CBSA and security agencies, CIC 
screens immigrants and temporary residents, assists with immigrant settlement and integration, 
and offers Canada’s protection to refugees and those in refugee-like situations. CIC supports 
the CBSA in managing and running Canada’s ports of entry. CIC provides information and 


other support to build intelligence to prevent inadmissible persons from reaching Canada and to 
detect persons who are in Canada but in contravention of IRPA. In March 2006, CIC and the 
CBSA formalized their close partnership through an MOU that defines how the two 
organizations work together to deliver all aspects of the immigration and refugee protection 


programs. As the MOU is implemented, CIC will continue to work closely with the CBSA to 


support the removal of inadmissible persons and to investigate the use of biometrics and other 


technologies in order to strengthen client identification and document and program integrity. 
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Why is this a good practice? 


In a section of the DPR called “Critical Partnerships,” Citizenship and Immigration Canada 
identifies its programs and services delivery partners, outlining respective and shared 
roles and responsibilities, as well as shared outcomes and objectives. 


\ Describe delivery mechanisms 


Delivery mechanisms are the ways in which programs and services are supplied to Canadians. 
These include policies, programs, regulations, and grants. In large part, this is how Canadians 
will see themselves in public performance reports. Clearly describing this interface provides key 
contextual information regarding the benefits gained by Canadians in the delivery of programs 
and services, as well as illustrates how their tax dollars are put to use. 


The delivery mechanisms should be employed with propriety, sound stewardship of resources, 
and fair treatment of people. This should be concisely demonstrated in both the planning and 
performance reports, using links to further information as required. Service improvement 
activities that affect a department’s delivery mechanisms should also be part of the discussion. 


Good practice: Describe delivery mechanisms 


Department of Finance Canada 
DPR 2006-07, p. 21 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/fin/fin00-eng.asp 


| The Tax Policy program activity develops and evaluates federal taxation policies and legislation 
and provides advice and recommendations for changes aimed at improving the tax systems 
while raising the required amount of revenue to finance government priorities. This program 
activity focusses on the following areas: personal income tax, business income tax, and sales 
and excise tax. The program activity is also involved with negotiating tax treaties, tax policy 
research and evaluation, as well as federal-provincial/territorial and federal-Aboriginal tax 
coordination. 
(le. er 


Why is this a good practice? 


The DPR indicates that, under this program activity, services are delivered through the 
provision of appropriate policies and legislation as well as through advice with respect to 
tax systems. 


27 


P 
ie 
a 


28 


Performance Reporting : Good Practices Handbook 2008 


\ Include responses to parliamentary committees and findings of the Auditor General 
of Canada 

The relationship between departments and Parliament is integral to Canada’s system of 
government and is not limited to the annual tabling of RPPs and DPRs. Interaction between your 
department and Parliament or the Auditor General of Canada, who is an officer of Parliament, 
over the course of the reporting cycle is meaningful and is documented in responses to 
parliamentary committees and findings of the Auditor General of Canada. 


Your report should include summaries of findings and responses and, keeping in mind the goal 
of comprehensive but succinct reports, provide links to the full versions. Information about how 
the department intends to take (specific) action can also be provided with. links; this information 
may already be part of the response. Identifying actions to be taken illustrates an approach to 
management that incorporates lessons learned and demonstrates how the relationships between 
Parliament and departments produce positive change. 


It should be noted that this good practice is also a recommendation from the sixth report of the 
House of Commons Standing Committee on Government Operations and Estimates, released in 
September 2003. 


[ ë 
Good practice: Include responses to parliamentary committees and findings of 


the Auditor General of Canada 


Health Canada 
DPR 2006-07, p. 117 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/shc/shc0O0-eng.asp 
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Responses to Parliamentary Committees, and Audits and Evaluations 


Response to Parliamentary Committee 


Standing Committee on Health 
Report #3 “Silicone Gel-filled Breast Implants: Areas of Concern” — tabled 
September 18, 2006 


Committee members heard testimony on the issue of silicone gel-filled breast implants. 
Witnesses included officials from Health Canada and the Public Health Agency of 
Canada; former members of Health Canada's Expert Advisory Panel on Breast Implants, 

Dr. Mitchell Brown and Dr. Paula Chidwick; and Dr. Diana Zuckerman, President of the 
National Research Center for Women and Families in the United States. Based on the 
evidence provided by these witnesses, the Committee identified key concerns regarding 
silicone gel-filled breast implants relating to several areas including safety assessments, 
special access, informed consent and post-approval surveillance. The Committee 

| acknowledges that these recommendations may require changes to the Medical Devices 
Regulations and/or other supporting documents. In its response, the Department 
recognizes the importance of each of the recommendations and the underlying concerns. 
Health Canada has considered each recommendation carefully and prepared a response to 
the concerns and advice contained in the Committee's report. The Government's response 
and actions are in line with the Committee's recommendations. 


Government Response (tabled January 17, 2007 
_ http://cmte.parl.ge.ca/emte/CommitteePublication.aspx? COM=10481&Lang=1&Sourceld 
=188754 


Why is this a good practice? 


The department reported its responses to parliamentary committees satisfactorily, citing 
the report and providing a synopsis of the issues and the response as well as several 
electronic links to further information in the summary table. Several references to the 
Committee or OAG report are also made in the body of the DPR, and the department 
describes the action called for and what it did in response. 
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Principle 2: Present concise, credible, reliable, and balanced 
information 


It is well accepted that a barrier to the use of public performance reports by parliamentarians is 
the perception that the objectivity of the reports is questionable. The CCAF’s 2005 study on 
users and uses of public performance reports substantiated this assertion.’ Concern over the 
reports containing only positive news means they are not seen as valuable tools to help 
parliamentarians in their work of holding the government to account and of communicating with 
their constituents about how Canadians benefit from government programs and services. 


It is important that a coherent, sound, and balanced picture of performance be presented in the 
DPR, ideally through a combination of qualitative and quantitative data, so that readers can be 
assured of the validity and reliability of the information presented. This requires the department 
to acknowledge where performance did not meet expectations, provide the necessary 
explanations as to why, and describe the corrective actions that will be taken in the future. 
Acknowledging performance that did not meet expectations shows that the organization is 
willing to adapt. 


The role of evaluation in applying this principle should be highlighted. Evaluation provides 
evidence-based, neutral assessments that are required to produce reporting that is credible, 
reliable, and balanced. | 


The addition of concise reporting as a key element of this principle is recognition of its potential 
for increasing the utility of reports. A concise style of reporting reflects the critical aspects of 
departmental planning and performance that parliamentarians require in their consideration of 
the Estimates and in their accountability roles. 


7. CCAF, Users and Uses — Towards Producing and Using Better Public Perfomance Reporting. Perspectives and 
Solutions (2005). 
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To apply this principle: 
> Use the MRRS as the basis of reporting 


> Describe internal performance systems and framework 


> Report positive and negative aspects of performance 

> Provide factual, independently verifiable, evidence-based performance information 
> Provide informative financial tables 

> Use comparisons and trends 


> Provide links to further information 


Ÿ Use the MRRS as the basis of reporting 
For performance information—financial and non- r a 
financial—the MRRS establishes a common approach for its | Connections 
collection, management, and reporting. The MRRS also 
provides a standard basis for the activities of planning, 
managing, and reporting. It is a logical organization of the 
programs being delivered (PAA) and the benefits to Link resources and results 
Canadians that departments are working to achieve (strategic |} Discuss priorities within the 


Present a clear PAA 


Link performance with plans jf 


outcomes). A key to the success of the MRRS Policy isthe | context of the MRRS 
development of systems for the production of credible and 


reliable performance information. 


The performance story presented in your reports should be at the program activity level. In turn, 
achievements at the program activity level that contribute toward the associated strategic 
outcome should be discussed. 


Reporting on the basis of the MRRS enables parliamentarians to follow the story—from plans to 
actual spending to actual results. This ability to follow the story extends beyond departmental 
reports to other documents, including the Main Estimates, the Public Accounts, and Canada’s 
Performance. 


Good practice: Use the MRRS as the basis of reporting 


Atlantic Canada Opportunities Agency 
DPR 2006-07, p. 45 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/aco/aco00-eng.asp 
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2.2.1 Program Activity: Community Economic Development 


Projects that help communities build their capacity and confidence in order to identify and co-ordinate 
the implementation of priorities for economic development in their region. These projects would be 
supported via community economic development organizations that, in turn: provide financial and 
technical assistance to businesses and communities; conduct strategic planning; co-ordinate economic 
development; and implement a range of self-sustaining development projects under strategic community 
economic development initiatives. Community economic development organizations can be any 
organization that supports projects at a local, community and sub-community or municipal level. 


Expected Results: Enhanced business and economic opportunities for Atlantic Canada communities 


Indicators: Annual Targets: (2006-2007) Results: 


e Jobs created by CBDCs and e 1,600 jobs e 1,864 °° 
Seed Capital Program | 


e Level of strategic investment in © $42.8 million e $54 million ”” 
communities (CBDCs and Seed 1,600 loans 1,799 loans 
Capital Program investments) 


Performance Measurement Strategy: Analysis of CBDC report data, and internal systems data 


Financial Resources ($ millions) 


Planned Total Actual 
Spending Authorities Spending 


42.8 10222 


Human Resources (Full-time Equivalents) 


Planned Actual Difference 


(75) 


Why is this a good practice? 


The overall basis of reporting is the PAA. The DPR does a good job integrating priorities 
into the performance story without making them the sole focus of the report. Reporting is 
clearly happening at the program activity level. Linkages are made between the program 
activity and strategic outcome levels. Sub-activity performance information further 
substantiates results at the program activity level. 


\ Describe internal performance systems and framework 


The use of an internal performance measurement system and framework should be evident in the 
report. The strongest way to demonstrate this would be to explicitly and directly discuss the 
system or framework, noting for example how developed it is with indicators, measures, and data 
sources. An additional approach would be to use data from the system in the discussion of results 
and clearly indicate the internal system as its source. To lend credibility to the use of the data, 
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it is important to discuss any drawbacks or gaps in the system and whether this affects either 
performance itself or the ability to report on performance. 


It is recognized that capacity for internal performance measurement will develop as the MRRS 
Policy is implemented. CCAF has identified the consistent use of measures year over year as a 
good practice. The performance system or framework should be based on the MRRS; evidence 
for this would be results information at the program activity level. 


Good practice: Describe internal performance systems and framework 


Department of Justice Canada 
RPP 2006-07, p.12 
http://www.tbs-sct.gc.ca/rpp/0607/Jus-Jus/Jus-Jus_e.asp 


This data quality assessment was provided by both internal and external technical experts. The 
Department is continuing with these practices in the next planning and reporting cycle. Thus, 
the results commitments listed in this report are made with the approval of the appropriate 
managers to ensure that the identified performance indicators are relevant, credible and valid, 
and that the internal capacity exists to collect the required data. 


The Department approaches performance measurement from two interrelated perspectives. 
First, there are those measures that are aimed at tracking performance of activities and 
outputs over which the Department has direct control and is directly accountable. Workload 
indicators such as files opened and closed, hours logged, etc., are examples of these types of 
measures. 


The second level of measures relate to the results of our activities over which we exercise 
influence. That is to say that while we cannot control the results of the activities, we do have 
some level of influence over the extent to which the results can be achieved. However, there 
are other identifiable groups who also either have influence or control over those results. As a 
result, accountability for those results is shared. By way of illustration, two examples of this 
type of measure are the number of people receiving assistance from Provincial legal aid 
programs, and client feedback on the timeliness, utility and responsiveness of legal services 
provided by the Department of Justice. 
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Why is this a good practice? 


The department's capacity for performance measurement is discussed in the RPP. 


\ Report positive and negative aspects of performance 


Balanced reporting enhances the credibility of reporting. Moreover, Connections 


reporting on both the positive and negative aspects of performance 
> Discuss lessons 
meets the intention of public performance reporting: to provide the 


learned and corrective 


necessary information for scrutiny and decision making. Telling 
; ions 
only half of the story is not useful. ae 


Performance information is not fairly presented when the information is limited to successes and 
minimizes, or even avoids, discussion of matters that did not unfold as planned. In order for 
reporting to be fair, key information must not be omitted. When discussing results achieved, 
discuss what went according to plan as well as cases where things did not go according to plan 
but risks were mitigated. Discuss results that were not achieved, noting how and why plans were 
not implemented as intended. It is also important to include explanations of how your department 
uses both positive and negative results to make adjustments and improvements toward achieving 
its strategic outcomes. Findings that emerge from evaluations are important sources of 
information in developing these discussions. 


Good practice: Report positive and negative aspects of performance 


Canadian Food Inspection Agency 
DPR 2006-07, pp. 10-11 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/ica/ica00-eng.asp 
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| Table 1.3.3 - Summary of Performance Results and Spending (April 1, 2006 to 


| March 31, 2007) (continued) 


Benefits to Canadians: Environmental Protection 


CFIA’s Contributions: Sustaining the plant and animal resource base 
CFIA’s Ongoing Priority. Effective protection of the environment and plant resource base 
CFIA’s New Priority: Development and implementation of a Pan-Canadian Animal Health Strategy 


Planned Spending & Full-Time Equivalents (FTEs) 


2006-07 
$106.7 million 1,146 FTEs 
_ Program Activity Expected Results 
Animal and Plant Entry and domestic 
Resource Protection spread of regulated plant 
diseases and pests are 
controlled 


(See Section 2.3.3 for a 
detailed description of 
performance results) 


Total Authorities 
2006-07 


$120.8 


sree 1,146 FTEs 
million 


Performance Indicators 


Extent to which Agency data indicate the entry 
of new regulated diseases and pests into 
Canada (listed diseases/pests in the 
Regulated Pest List for Canada) 


Change in the presence of plant diseases or 
pests beyond the regulated areas 


Extent to which pests surveys are conducted 
as per workplan 
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Actual Spending & Full-Time Equivalents (FTEs) 
2006-07 


$140.1 million 


Targets 
Opportunity for Improvement (X) 
or Met (\) or Exceeded (1+) 


2005-06 2006-07 
\ X 


7 of 11 targets met or 
exceeded 


9 of 13 targets met or 
exceeded 


1,431 FTEs 


Example of Achievements 


Developed Canadian Invasive Plant Framework (see 
Section 3.1) 


Developed draft containment standard for facilities 
handling plant pests (see Section 3.1) 


In collaboration with partners, established Vice 
Presidents/ADMs Level committee for biotechnology 
related issues (see Section 3.1) 


Developed highly needed diagnostic reagents and 
assays for rapid response to foot and mouth 
diseases (see Section 3.3) 


Conducted several meetings and consultations 
regarding the establishment of the National Animal 
Health Strategy for Canada (see Section 3.1) 


Why is this a good practice? 


The DPR demonstrates honesty in reporting. For each performance target that was missed, 
the report indicates whether the results observed were an improvement or a decline from 


the previous period. The report further explains why targets were missed and what the 


organization intends to do to improve. 


5 


Ÿ Provide factual, independently verifiable, evidence-based performance information 


Discussion of your department’s performance should be 
substantiated with factual, independently verifiable, evidence-based 
information. Balanced, evidence-based reporting leads to realistic 
conclusions about the department’s performance and gives readers 


confidence in those conclusions. 


Connections 


>» Discuss lessons 
learned and 
corrective actions 
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In order for readers to have confidence in the methodology and data used to substantiate reported 
performance, an indication of the validity and credibility of data used should be provided. This 
can be achieved by indicating the source of the information, particularly if graphs or tables are 
presented. A brief discussion of the measures taken to ensure the reliability of the data upon 
which the performance report is based is also important, particularly for data from internal 
sources or data systems, and for data collected from external partners. Both qualitative and 
quantitative data are sources of valid performance information. Limitations or problems with the 
underlying data, and any caveats regarding proper interpretation of the information reported, 
should also be noted. 


Identifying sources of data (information) is critical to establishing credibility. It offers readers the 
opportunity to directly validate what has been included in your report or it provides a reference 
point from which to make inquiries for further information. 


The findings of approved evaluation and audit reports are accepted as key sources of credible 
analysis of performance. Reference any significant findings, explain their relationship to 
departmental performance, and identify the next course of action to improve departmental 
results. 


Good practice: Identify sources of data 


Atlantic Canada Opportunities Agency 
DPR 2006-07, p. 31 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/aco/aco00-eng.asp 
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Return on investment for these types of missions has been significant. The 13 Team Canada 
Atlantic missions are a prime example, with over $40 million in sales generated, resulting in 
over a six-to-one return on investment for the Agency. Furthermore, the 490 Atlantic SMEs 
who have participated in these missions held over 3,300 business meetings with potential 
clients. In 2006-2007, the Team Canada Atlantic missions assisted 62 exporters increase their 
‘export-readiness in the Florida market, with 31 SMEs developing new markets and over $60 
million in forecasted sales.” 


Federal-provincial initiatives play key roles in the Agency’s development of the export capacity 
of the Atlantic region. In addition to Team Canada Atlantic missions, the International Business 
Development Program also posted strong results. This program, aimed at strengthening 
exporting in Atlantic Canada, helped SMEs become first-time exporters, and increased sales to 
current markets for 16 SMEs.” For more information on this horizontal initiative and other 
initiatives please refer to http://www.tbs-sct.gc.ca/rma/eppi-ibdrp/hrdb-rhbd/profil_e.asp. 


33. May 2006 Florida Trade Mission Exit Study, Corporate Research Associates Inc. (September 2006); October 2006 Florida Trade Mission 
Exit Study, Corporate Research Associates Inc. (March 2007). It should be noted that one successful mission participant is projecting 
$35 million in sales from the Florida Tier 2 mission, which exceeded planned results and a significant increase in projected sales. 


34, Survey of IBDA Projects; September 2006, January 2007. 


Why is this a good practice? 


The DPR includes extensive citations, including references to Statistics Canada data, 
formative and summative evaluations, internal studies, independent research reports, 
semi-annual reports, reports from financial institutions, and other information sources. The 
level of substantiation, the credibility, and the likelihood that an external party could verify 
the information are high. 


Good practice: Provide caveats regarding data quality 


Canada Revenue Agency 
DPR 2006-077 ppi16=1/ 7 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/nar/nar00-eng.asp 
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Rating Our Data Quality 


In conjunction with the performance results ratings, we also assign each indicator a data quality 
rating. 


For each indicator we use consistent approaches in evaluating the information derived from our 
data collections systems and all other sources. We rely upon CRA managers to vouch for the 
completeness of the records for data integrity purposes (i.e., data belongs to the same category, 
is collected for the same period, and by the same method). We examine data for relevance, 
formulas for accuracy, and other factors that must be considered. We also use comparable 
information from prior years for the purpose of historical comparison, which often appears in 
the Annual Report. To ensure consistency, we perform the following tasks to verify that the 
information reported in our numerous reports is valid, reliable, and is accompanied by 
appropriate evidence: 


e Validation: This is a process of verification to ensure that the data meets the requirements 
for its intended purposes. We review and evaluate data for completeness and plausibility 
(accuracy, timeliness, interpretability, coherence). We also identify contact information, 
check calculations, confirm system reliability (verifying the source of information), and note 
and address any errors. 


e Data quality assessment: We apply a data quality checklist and review prior years’ data to 
assess the quality of data for each indicator. 


e Electronic filing system: We store data in a database for easy reference and further analysis 
for other purposes. 
e Physical filing system: We maintain physical files of the evidence collected from all sources 
to provide validation and assurance that our data quality ratings are accurate and supported. 
We always endeavour to use the most appropriate and reliable data when evaluating our results. 
There are mainly two data sources for the Annual Report: administrative data (normally 
communicated in aggregate or after some simple calculations are performed on them) and 
survey data. All data sources are validated for accuracy and a data quality rating of good, 
reasonable or weak as categorized below is applied to each indicator. 


We believe that these three levels of data quality ratings provide a reasonable assessment of the 
reliability of the data. Generally, our data sources provide reliable information. In situations 
where the supporting data is too imprecise to draw firm conclusions, it is reflected in the data 
quality rating. 


OM, 
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Data Quality Ratings 
Data Quality Ratings 


Good Results rating based on management judgment supported by an appropriate level 
of accurate information (including management estimates) obtained from reliable 
sources or methods. 


Reasonable Results rating based on management judgment supported, in most cases, by an 
appropriate level of accurate information (including management estimates) 
obtained from reliable sources or methods. 


Weak Significant gaps in robustness of results information; results rating based on 
management judgment supported by entirely or predominantly qualitative 
information from informal sources or methods. 


Why is this a good practice? 


A discussion regarding data quality is effective in supporting performance claims in the 
DPR. The data quality ratings are explained at the beginning of the report and applied 
throughout. 


Good practice: Use audit and evaluation findings in performance discussions 


Parks Canada 
DPR 2006-07, p. 51 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/cap/cap00-eng.asp 
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Engaging Canadians at Home 


The web is a tool increasingly used by visitors, partners and stakeholders, urban youth and 
educators. A Canadian Radio and Television Commission study on new media reveals that 
nearly two-thirds of the country’s households were on-line in 2006 and that use of the Internet 
to search for specific information was the second most popular online activity, only e-mail 
surpassed information search. 


In 2004, an evaluation was conducted of the Parks Canada website. That evaluation showed that 
a majority of users (54%) visited the website to plan a trip. Parks Canada recognizes that the 
first step in the trip cycle is the pre-trip planning — a step usually initiated at home. Parks 
Canada offers a multi-channel suite of pre-trip planning services: the web, the national toll-free 
information line, the campground reservation service and printed material. 


In 2006, Parks Canada revised the structure, design and visitor information content available on 
our website. This was done to bridge the identified gaps between consumers’ needs and 
expectations and what the website had offered. The new “Planning Your Visit” section of the 
website was launched as information for each park and site was compiled, in February and 
March 2007. 


Why is this a good practice? 


The findings of an evaluation are briefly described and actions taken in response are 
outlined. The rationale for the course of action is also included. The report goes on to 
explain how the impact of the changes will be assessed. 


\ Provide informative financial tables 


Basic to performance reporting is linking resources to results (to be na 
discussed in more depth under Principle 4) and therefore an accurate Connections 
and thorough presentation of financial tables (i.e. resources) is key for || — 
accountability to Parliament. In addition, financial tables illustrate the 
link to the financial appropriations given to departments through the 
supply process. Financial tables need to be easy to understand and 
interpret for the layperson, and their layout and format should 
facilitate clarity because these all contribute to the user-friendliness of 
the report. 


Link resources and 
results 


Discuss changes in 


resources 
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Immediately following financial tables should be a discussion of their content. Just as the tables 
should be easy to understand and interpret, explanations of the financial table should be clear, 
simple, and effective so that a layperson could interpret the information, see links between 
resources and results, and make informed conclusions. 


Good practice: Provide informative financial tables 


Public Service Commission of Canada 
DPR 2006-07, p. 23 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/psc/psc00-eng.asp 


RESOURCES 


2006-2007 Financial Resources ($ thousands) 


Program Activity cannes Total Budget Actual 

pending Authorities Spending 
Appointment Integrity and Political Neutrality 41,519 41,986 40,355 
Recruitment and Assessment Services 63,275 65,834 58,521 
Total 104,794 107,820 98,876 


“Note: All Total Budget Authorities presented in this document exclude internal adjustments which were 
reflected in the Planned Spending figures. 


2006-2007 Human Resources (Full-Time Equivalents) 


hie Planned Total Budget Actual 
Program Activity : ae : 
Spending Authorities Spending 
Appointment Integrity and Political Neutrality 392 386 991 
Recruitment and Assessment Services 634 652 581 
Total 1,026 1,038 932 


Financial Performance Highlights 


The PSC has spent $98,876K of the Total Budget Authorities of $107,820K, resulting in a lapse of 
$8,944K appearing in the 2006-2007 Public Accounts of Canada. 


The lapse and variance in Full-Time Equivalents are principally due to the transition period and related 
capacity building associated with the implementation of the new PSEA, staffing delays resulting from 
increased staff turnover and less than anticipated expenditures for an information technology project — 
the Public Service Staffing Modernization Project. The latter accounts for approximately $7,470K of the 
total lapse ($4,917K of which the PSC received permission to spend in 2007-2008). 


Performance Reporting : Good Practices Handbook 2008 Re > 


Why is this a good practice? 


Financial tables in Sections 1 and 2 of the DPR are straightforward and clear. Variances 
between numbers are clearly explained following the respective table. 


V Use comparisons and trends 


Comparisons of performance by similar organizations or between jurisdictions add credibility to 
performance data collected by your department. Use of comparisons can help readers better 


understand both achievements and shortcomings. The comparisons chosen should be relevant 
and informative. For example: 


>» comparisons of the same organization between years or over time (trend information); 


> progress made at the program activity level as compared to changes at the strategic outcome 
level 


> indicators (e.g. prenatal health practices versus infant mortality rate); and 


> actual performance against baseline information, targets, service standards, and benchmarks. 


Good practice: Use comparisons and trends 


Canadian Space Agency 
DPR 2006-07, p. 11 


http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/pen/pen00-eng.asp 


Regional Distribution of Canadian Space Program Contracts 
tee of Mareh 31, 2007) 


D'Objucüves Ch) 
@ Results (o) 


{TL argerc pe tgriges 


8.Columbla Prairies Ontario Quebec Atlantic 


Source: CSA Organized Research Information System (ORIS) — Regional distribution of 
CSA contracts, March 31, 2007 


To leam more about Canadian space-related organizations. go to: 
http://www space gc ca/asc'eng industry/csd.as 
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Why is this a good practice? 


Readers are able to compare results across geographic regions, against those of the 
previous year and, importantly, against planned results. 


\ Provide links to further information 


A concise style of reporting emphasizes the critical aspects of departmental planning and 
performance that parliamentarians require in their consideration of the Estimates and in their 
accountability roles. One way of achieving this concise style is to include electronic links in the 
report, which are an effective way of providing readers with additional information without 
adding unnecessary length to these reports. 


An increased focus on a concise style of reporting will ensure that accountability and 
performance information is at the forefront of the DPR as well as improve the clarity 
and user-friendliness of these documents. 


Good practice: Provide links to further information 


Environment Canada 
DPR 2006-07, p. 33, 35 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/doe/doe00-eng.asp 
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Major programs and initiatives | 


Expected Result: Integrated information and knowledge enable integrated approaches to 
protecting and conserving priority ecosystems 


Activities: Management (e.g. development and management of agreements and memoranda of 
understanding (MOUs), policy development, partnership management, performance 
measurement and assessment, strategic communications supporting effective delivery of 
priority ecosystems). 


Community engagement and capacity development (e.g. activities related to the development, 
support and coordination of community engagement and capacity development in order to 
support effective delivery of priority ecosystems). 


Integration (e.g. implementation of an ecosystem approach for the Department, development of 
a Priority Ecosystem Management Framework, coordination of priority ecosystems to achieve 
better integration and effectiveness amongst various initiatives). 


Action (e.g. integrated implementation of activities and programs that lead to the improvement 
of the state (environmental quality) of priority ecosystems across the country). 


Key Indicators Progress in 2006-2007 


Declassification of Progress for this indicator include the following: 


special areas (e.g. areas 
of concern, restricted 
fishing areas) 


e Restoration of sector 103 of the Montreal Harbour advanced well 
with dredging of contaminated sediments to be finished during 
the summer of 2007 at a total cost to the four financial partners of 
$10 million; 


e Restoration of the mouth of the St. Louis River was carried out 
during the summer of 2006 at a cost of $8 million to the two 
financial partners; 


For Further Information: 


Ecosystem Initiatives: http://www.ec.gc.ca/ecosyst/backgrounder.html 
Atlantic Coastal Action Program: http://atlantic-web1.ns.ec.gc.ca/community/acap/ 
St. Lawrence Plan: http://www.planstlaurent.qc.ca 

Great Lakes Basin Ecosystem Initiative: http://www.on.ec.gc.ca/greatlakes/ 
Western Boreal Conservation Initiative: http://www.pnr-rpn.ec.gc.ca/boreal 
Georgia Basin Action Plan: http://www.pyr.ec.gc.ca/georgiabasin/index_e.htm 
Northern Ecosystem Initiative: http://www.pnr-rpn.ec.gc.ca/nature/ecosystems/nei- 
ien/index.en.html 
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Why is this a good practice? 


Summary tables for each program activity are presented and links to further information 
on specific programs and initiatives are provided at the end of each table. 


Performance Reporting : Good Practices Handbook 2008 I Fr 


Principle 3: Associate performance with plans, priorities, and 
expected results, explain changes, and apply lessons learned 


The core elements of a public performance report are descriptions of what an organization 
planned to accomplish, how the actual results compare with those plans, explanation of any 
significant differences, and identification of lessons learned. Information in an RPP and a DPR 
should facilitate comparisons between reports and over time. 


This principle touches on the essentials of results-based management. Results-based 
management is a life-cycle approach to management that integrates strategy, people, resources, 
processes, and measurements to improve decision making, transparency, and accountability. The 
approach focusses on achieving outcomes, implementing performance measurement, learning 
and changing, and reporting performance. This is illustrated in the diagram below. 


Planning involves the articulation of strategic choices in light of past performance and includes 
information on how an organization intends to deliver on its priorities and achieve associated 
results. 


Measuring and assessing are practices through which progress is determined. Performance 
measurement and evaluation present valuable opportunities to learn and adjust so that the 
intended results may be achieved. 


The final stage of the life-cycle approach involves reporting on results through the provision of 
integrated financial and non-financial information. Results-based information is used for both 
internal management purposes and for external accountability to Parliament and Canadians. The 
reporting phase also provides managers and stakeholders with the opportunity to reflect on what 
has worked and what has not: a process of learning and adjusting that feeds into the next 
planning cycle. 
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Figure 3: Results-based Management Life Cycle 


Learning and 
Adjusting 


Reporting on 
Results 


Measuring and 
Assessing 


Planning 


To apply this principle: 
> Present clear performance expectations in the RPP 
> Link performance with plans 


> Discuss lessons learned and corrective actions 


\ Present clear performance expectations in the RPP 

A well-written and properly organized RPP has a positive impact on the quality of the DPR. 
Planning information on how the department intends to make progress toward its strategic 
outcomes, how it will address priorities, and what it intends to achieve through its program 
activities (and, if applicable, key programs and services) should lay the foundation for DPRs. 
With performance expectations clearly set out in the RPP, readers will not have to infer the 
expected results and will be able to trace them to the actual performance reported in the DPR. 
Further, identifying indicators and targets in the RPP that will be used for reporting on 
performance in the DPR supports the credibility of the performance story. 


Good practice: Present clear performance expectations in the RPP 


Atlantic Canada Opportunities Agency 
RPP 2006-07, p. 35 
http://www.tbs-sct.gc.ca/rpp/0607/ACOA-APECA/ACOA-APECA_e.asp 
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Program Activity: Community Economic Development 


Projects that help communities build their capacity and confidence in order to identify and co- 
ordinate the implementation of priorities for economic development in their region. These projects 
would be supported via Community Economic Development Organizations (CEDOs) that, in turn, 

provide financial and technical assistance to businesses and communities; conduct strategic 


planning; and co-ordinate economic development projects under a range of self-sustaining 
development projects under strategic Community Economic Development (CED) initiatives. 


Expected Results: Enhanced business and economic opportunities for Atlantic Canada communities 


Indicators Annual Targets: (2006-2007) 


e Jobs created by CBDCs and the Seed Capital Program e 1,600 jobs 
e Level of strategic investment in communities e $42.8 million 
e 1,600 loans 


Performance Measurement Strategy: Analysis of data from CBDC reports and internal systems. 


2006-2007 2007-2008 2008-2009 
Financial Resources ($ millions) 42.8 44.6 44.8 


Human Resources (FTEs) 79 81 81 


Why is this a good practice? 


Performance expectations in the RPP are very clear, including expected results and targets 
for each strategic outcome, program activity, and program sub-activity. 


V Link performance with plans 

At its most basic, linking performance to plans means making sure that your RPP and your DPR 
are consistent in terms of form and content. Reporting on the basis of the MRRS will go a long 
way to ensuring a common framework (strategic outcomes and program activities) for the two 
reports, as well as generating a cohesive planning and performance story. 


Readers should not have to question the consistency between the reports. Changes to plans and 
how those changes affected expected results need to be explained. Plans presented in the RPP but 
not discussed in the DPR would confuse readers, as would a restatement of the expected results 
from the RPP in different terms in the DPR. 
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Good practice: Link performance with plans 
Parks Canada 
DPR 2006-07, p. 27 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/cap/cap00-eng.asp 
a 


Program Activity 2: Conserve Heritage Resources 


Maintenance or improvement of ecological integrity in national parks; the sustainable use of national 
marine conservation areas and the protection of unique marine ecosystems; the maintenance and 
improvement of commemorative integrity in national historic sites managed or influenced by Parks 
Canada; and the protection and management of cultural resources under the administration of Parks 


2005-2006 


2006-2007 


Planned Total Authorities Actual Actual | 


225,035 207,772 


1520 


National Parks and National National Historic Sites and | Other Heritage Resources | 
Marine Conservation Areas | Cultural Resources | | 


| 
| 
{ 


‘Maintain and improve the Maintain or improve the Support and encourage 


ecological integrity of national commemorative integrity of ‘commemorative integrity of | 

2 parks and the sustainability of national historic sites; maintain national historic sites; | 

© © national marine conservation ‘or improve the state of other contribute to maintaining and | 

| 5 & ‘areas. ‘cultural resources administered improving the state of | 

28. by Parks Canada. heritage resources not | 
5 | administered by Parks 

ro Br | ‘Canada. 

E & 7. National park and NMCA 12 Complete NHS 115. Other owners of national | 

= £ management plans will be on management plans, consistent historic sites are aware of CI | 

a ¢ schedule and consistent with with management plan and have access to 

@ management plan guidelines by guidelines by December 2006. information on best practices | 


March 2010. in maintaining CI. 


Planned Results and 
_Performance Expectations Cont. 


Status 


8. Bevelop fully net ino, EL 
‘monitoring and reporting systems 
for all national parks by March 
2008. 


'9. Develop selected indicators and | 
‘protocols for measuring NMCA 
ecological sustainability use by 
‘March 2009. 

110. Improve aspects of the state of | 
parks by March 2014. 


\ 
| 


111. Meet targets for five measures 


gas emissions, petroleum storage 
‘tanks, contaminated sites, 
‘halocarbons and polychlorinated 
biphenyls | AS 


17. Reasonable Progress: AS of 
‘March 2007, 33 of 42 national 
‘parks had approved management 
plans consistent with the 2000 
‘Guidelines for Management 
(Planning. Three national parks 


‘operate under interim management 


guidelines and the remaining six 
‘are engaged in the planning 
process. In 2006-2007, one plan 
‘amendment was tabled in 
Parliament. 


The management plan for Fathom | 


‘Five Marine Park was approved in 
1998. The plan review has been 
‘rescheduled for 2008. The 
‘management plan for Saguenay- 
St. Laurent was tabled in 
Parliament in 2000. The review is 


scheduled for 2008. 


Er Improve 80% of the 


El in each of Canada’s 42 national | 


of environmental impacts of Parks | 
{Canada's operations: greenhouse | 


412. Reasonable Progress: del 45. (Reasonable Progress: 
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16. eae Re 
recommendations or 
certification of interventions to. 
built cultural heritage 
consistent with The 
‘Standards and Guidelines for | 
the Conservation of Historic 
Places i in Canada as 
opportunity permits. 


‘elements of commemorative 
integrity rated as poor to at 
least fair condition within five 
years of the original 
assessment. 


14. Improve the state of other 
cultural resources managed by | 
‘Parks Canada by March 2014. 


Agency has completed 
management plans for 131 of 
151 sites requiring plans. 17 of 
the remaining 20 plans relate to | 
sites in Atlantic Canada where 
agreements and protocols for 
‘First Nation consultation and 
‘engagement were deemed 
inadequate subsequent to the 
‘Haida Nation and Taku River 
First Nation Cases (court 
decisions). 


Parks Canada surveys other 
‘owners of national historic 
sites every 2-3 years. Based 
on the last survey in 2004- 
2005, 46 % of owners were 
aware of the term 
‘commemorative integrity and | 
164 % stated that they had | 
access to information and 
best practices in maintaining | 
commemorative integrity. In | 
preparation for the next 
survey of other owners, Parks | 
Canada i is refining its | 
‘measures and setting targets | 
for understanding of and 
| ‘access to commemorative 
| .  lintegrity advice. | 


N 
À 


51 


> 4 Performance Reporting : Good Practices Handbook 2008 


92 


Why is this a good practice? 


The planned results and performance expectations are clearly articulated in the RPP and 
are presented in numbered format in a summary table for quick reference and easy 
comparison with the information reported in the DPR. The DPR presents the performance 
expectations and reports on performance where each numbered statement is clearly and 
comprehensively addressed—both in summary form and more fully later—in the report. 


\ Discuss lessons learned and corrective actions 


Revising and improving plans are indications of sound Connections 


management practices. Departmental plans are expected 


to change in response to, among other things, lessons » Report positive and negative 


_aspects of performance 


learned from past performance. Changes resulting from 
lessons learned during the reporting period should > Provide factual, independently 
therefore be explained. The effect of these changes on verifiable, evidence-based 
actual planning and performance, and in measuring and performance information 


reporting on performance, should also be discussed. 


The first thing to do is identify the lessons learned and actions taken as a result. Demonstrate to 
readers that lessons learned are consciously (systematically) tracked and, in turn, purposefully 
applied in order to adjust plans. This shows a commitment to continuous learning and 
improvement. For example, the RPP identifies corrective or strategic actions to be taken as a 
result of lessons learned discussed in the previous DPR; the DPR then reports on those actions. 
The DPR also communicates new lessons learned over the reporting period, and the RPP should 
then reflect how these lessons learned have affected future plans. Other details to include in the 
discussion are the source of any lessons learned (e.g. an audit, evaluation, or performance 
measurement data); innovative ways of identifying and using lessons learned; evidence of using 
good practices to improve managing for outcomes; and evidence of integrating lessons learned 
into plans and discussing the effect of their adoption on performance. 


Good practice: Discuss lessons learned and corrective actions 


Foreign Affairs and International Trade Canada 
DPR'2006-07 p751 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/ext/ext00-eng.asp 


Performance Reporting : Good Practices Handbook 2008 bp > 


Lessons Learned 


Based on past experience in managing the response to natural disasters abroad, the department 
understands the importance of clearly identifying the roles and responsibilities of federal 
departments in this area. The Guidance Tool developed with Public Safety Canada is an 
important example of efforts to clearly establish a coordination and accountability mechanism 
in advance of a catastrophic disaster in the United States in order to facilitate a timely and 
effective whole-of-government response. 


START and the GPSF meet policy and operational challenges that include managing staff 
security in locations around the world; securing and delivering program resources at the rhythm 


of international crises; and mobilizing and deploying civilian resources to non-permissive 
environments. These challenges require program managers to seek flexible, innovative solutions 
with respect to program delivery on an ongoing basis. 


The institutional capacity of African regional and subregional institutions remains a key 
challenge in achieving target dates for increased African peacekeeping capacity. The capacity of 
the Afghan National Police to manage infrastructure and equipment remains weak. To address 
this issue, the department will continue to work closely with G8 partners, the UN, the European 
Union and other donors. Solutions under discussion include building institutional capacities 
with recipient organizations to allow them to enhance their performance, and building 
mechanisms into donor activities to implement and control projects. 


_— 


Why is this a good practice? 


Lessons learned are identified and discussed for each program activity. Looking ahead, 
potential solutions are identified. 
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Principle 4: Link resources to results 


Fundamentally, accountability from a public reporting perspective means explaining what has 
been accomplished with the resources entrusted to a department in relation to what was planned 
and demonstrating whether performance represents a responsible, efficient, and effective use of 
public funds. In order to assist parliamentarians in their accountability roles, their decisions 
about the funding of programs should be informed and influenced, in part, by the results of 
programs. 


Resources and expenditures (on a near-cash basis, both planned and actual) for program 
activities are displayed in a number of expenditure management documents, such as the Main 
Estimates and the RPP. The DPR therefore needs to discuss departmental results on the same 
basis—that is, both resources and results should be presented at the program activity level so that 
parliamentarians and Canadians can track planning and performance information from one report 
to another and see the full picture of performance in relation to spending. In addition, the DPR 
should include informative, accrual financial statements that give as complete a picture as 
possible of financial performance in relation to the non-financial performance discussed above. 


As departments explain how program activities contribute to strategic outcomes, and what 
influence they expect to have on longer-term outcomes through their actions, it is important that 
parliamentarians understand the cost. 


To apply this principle: 
> Link resources to results 


» Discuss changes in resources 


\ Link resources to results 


Planned and actual spending should be outlined in sufficient detail for readers to understand 
how the department performed financially. Notes to financial tables should be clear and 
understandable (see discussion of financial tables). 


The relationship between planned and actual spending and expected and actual results should 
be explained in order to provide a full account of financial and non-financial performance for 
strategic outcome(s) by program activity. Explanations could include, where appropriate, 

a discussion of actual results in relation to the actual expenses outlined in your department's 
financial statements. 
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For each program activity in the RPP, it should be clear what the department intends to spend 
and what it intends to achieve over the next three years. In the DPR, it should be clear what the 
department spent for each program activity and what was achieved as a result of that spending, 


how actual spending compared to planned spending, and whether it represented value-for- 
money. 


Human resources—planned and actual—should also be linked to results. An understanding of 
the work force required to deliver programs and services to Canadians and to support the 
operations of government is essential. 


Good practice: Link resources to results 


Fisheries and Oceans Canada 
DPR 2006-07, p.15 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/dfo/dfo00-eng.asp 
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Results Chain 


Strategic 
Outcome 


expected 
results 
which result 
in this 


these 
priorities 
and 
activities 
which 
produce 
these 


These 
resources 
fund 


+ Minimal loss of life, injuries 
and property damage 
resulting from marine 
incidents 

+ Effective and efficient 
management of waterways 
that support marine 
commerce 

+ Sustainability of the marine 
and freshwater environment 
through timely and effective 
response 

+ À marine infrastructure that 
provides efficient services 
to all clients 


Priority 


* Coast Guard Rejuvenation 


Ongoing Activities 

+ Aids and waterways 
services 

+ Marine communications 
and traffic services 

+ Icebreaking services 

+ Search and rescue services 

+ Environmental response 
services 

* Coast Guard college 

* Other government 
objectives 

+ Coast Guard fleet 


$547.5 million 
4,752 FTEs 


Canadian Coast Guard 
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Safe and Accessible 


Waterways 


+ A network of harbours 
essential for Canada’s 
commercial fishing industry 
that is open, safe, efficient 
and in good repair 

+ Program directions adjusted 
to place the Program on a 
more sustainable basis, 
while addressing evolving 
program requirements and 
client needs 

+ Major repairs and 
maintenance to core fishing 
harbours undertaken 

* Recreational and non-core 

fishing harbours divested 

and core fishing harbours 
modified to better meet 
demand 


Priority 
+ Departmental Renewal 


Ongoing Activities 
+ Operations 

+ Maintenance 

* Divestiture 


$101.2 million 
124 FTEs 


Small Craft Harbours 


Why is this a good practice? 
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* Science information 
{oceanographic information 
and hydrographic products 
and services) are used to 
achieve safe navigation and 
sovereignty and protection 


Priority 


+ Science Renewal 


Ongoing Activities 

* Providing products and 
services for navigation 

+ Supporting maritime safety 
and security and Canadian 
sovereignty 


$55.2 million 
273 FTEs 


Science 


The linkage between resources and results is well articulated in the DPR. For each strategic 
outcome, the DPR includes a brief discussion of how program activities contribute to the 
strategic outcome, and includes a graphic that shows this results chain and the level of 
resources used to achieve these results. 
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\ Discuss changes in resources 


It is important to demonstrate that resources are being used 


efficiently and effectively, that expenditures correspond to the Connections 
relevance and importance of the outputs and short-term results » Provide informative 
achieved, as well as the strategic outcomes being pursued. financial tables 


Significant internal reallocations to meet emerging internal priorities or higher government 
priorities, or to better sustain progress toward the achievement of the strategic outcome(s), 
should be discussed (i.e. amounts and areas affected, including the source of funds for the 
reallocation, human resources implications, and the identification of the program or initiative 
that received the funding). Appropriate references should also be made in the financial tables. 


Your report should discuss the impact of reallocation, expenditure review, or restraint exercises 
on your organization’s performance at the program activity level and their ability to contribute to 
the strategic outcome(s). Doing so will make the report more credible. 


Good practice: Discuss changes in resources 


National Defence 
DPR 2006-07, p. 12 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/inst/dnd/dnd00-eng.asp 
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Effect of Government Efficiency Initiatives on Sustainability 


Two significant Government of Canada efficiency initiatives continued to reduce the effective 
net increase in Defence funding. In particular, the Expenditure Review Committee (ERC) and 
Procurement Program Reform (PPR) initiatives effectively reduce total allocations beginning in 
fiscal 2005-2006 and continuing for several years. Implementing these programs has been 
challenging, and DND is now managing the impact on operational sustainability of existing 
systems because the funding provided for expansion and new equipment was directed to specific 
procurements or activities. The net result for fiscal 2006—2007 was a reduction of 23 percent in 
the planned increase to general sustainability funding. 


The following table summarizes the net effect of the Budget 2005 and Budget 2006 
sustainability increases, and the application of the ERC and PPR reductions to Defence. 


Effect of ERC and PPR on Operational Sustainability Funding From Budget 2005 and 
Budget 2006 ($ Millions) 


2006-2007 

Budget 2005: | . | 500 
Operational Sustainability 
Budget 2006: 148 
Operational Sustainability (proposed for fiscal 07-08 and beyond) 

Less: Defence reductions called for by ERC and PPR (150) 
Net allocation to Sustainability : $498 
Source: Vice Chief of the Defence Staff Group 

(a il 


Why is this a good practice? 


The National Defence DPR discusses the effect of Expenditure Review and Procurement 
Program Reform over the reporting period and places the reductions in the context of 
increases from Budget 2005 and Budget 2006. Further details are provided on the 
following page of the DPR. 


Performance Reporting : Good Practices Handbook 2008 Ps pr 


Appendix 


Resources 


Guide to the Preparation of Part III of the 2007-08 Estimates 
http://www.tbs-sct.gc.ca/dpr-rmr/2007-2008/guide/guide00-eng.asp 


Reports on Plans and Priorities (2008-09) 
http://www.tbs-sct.gc.ca/rpp/2008-2009/index-eng.asp 


Departmental Performance Reports (2006-07) 
http://www.tbs-sct.gc.ca/dpr-rmr/2006-2007/index-eng.asp 


Canada’s Performance 2006-07 
http://www.tbs-sct.gc.ca/reports-rapports/cp-rc/2006-2007/cp-retb-eng.asp 


RPP Overview for Parliamentarians (2008) 
http://www.tbs-sct.gc.ca/ppg-cpr/plan-eng.aspx?Rt=1037 


Government of Canada Planning and Performance Gateway 
http://www.tbs-sct.gc.ca/ppg-cpr/home-accueil-eng.aspx 


Results-based Management 
http://www.tbs-sct.gc.ca/rma/rbm-gar_e.asp 


Management Accountability Framework 
http://www.tbs-sct.gc.ca/maf-crg/index_e.asp 


Management, Resources and Results Structure Policy 
http://www.tbs-sct.gc.ca/pol/doc-eng.aspx?id=12412 


Results-based Management Lexicon 
http://www.tbs-sct.gc.ca/rma/lex-lex_e.asp 
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Glossary 


Accountability: The obligation to demonstrate and take responsibility both for the means used 
and the results achieved in light of agreed expectations. 


Evaluation: The systematic collection and analysis of evidence on the outcomes of programs to 
make judgments about their relevance, performance, and alternative ways to deliver them or to 
achieve the same results. 


Government of Canada Outcome: The long-term and enduring benefits to Canadians that more 
than one federal department or agency is working to achieve. 


Management Accountability Framework: A set of 10 statements summarizing the Treasury 
Board of Canada Secretariat's and the Canada Public Service Agency’s expectations for modern 
public service management. It was developed to provide public service managers, especially 
deputy heads, with a clear list of management expectations within an overall framework for high 
organizational performance. 


Management, Resources, and Results Structure (MRRS): A common, government-wide 
approach to the collection, management, and reporting of financial and non-financial 
performance information. The MRRS is intended to be a useful management tool that provides 
departments, central agencies, and parliamentarians alike with the framework needed to support 
results-based management practices across the federal government, demonstrate value-for- 
money, as well as provide key stakeholders with the information necessary to support decision 
making. The MRRS is developed from a Program Activity Architecture (PAA). 


Program Activity Architecture (PAA): An inventory of all the programs undertaken by a 
department or agency. The programs are depicted in their logical relationship to each other and 
to the strategic outcome(s) to which they contribute. The PAA is the initial document for the 
establishment of a Management, Resources, and Results Structure (MRRS). 


Strategic outcome (SO): A long-term and enduring benefit to Canadians that stems from a 
department or agency's mandate and vision. It represents the difference a department or agency 
intends to make for Canadians, and should be measurable and within the department or agency's 
sphere of influence. 


Contacts 


DPR Contacts 


Tim Wilson: 613-957-7048 
Paula Folkes: 613-957-7046 


RPP Contacts 


Estelle Purdy: 613-952-3376 
Jo-Anne Munro: 613-957-0567 


Whole-of-Government Contact 
Anna Blaszczynska: 613-957-2528 
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